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Abstract. Large deviation functions of configurations exhibit very different 
behaviors in and out of thermal equilibrium. In particular, they exhibit singularities 
in a broad range of non-equilibrium models, which are absent in equilibrium. These 
singularities were first identified in finite-dimensional systems in the weak-noise 
limit. Recent studies have shown that they are also present in driven diffusive 
systems with an infinite-dimensional configuration space. This short review describes 
singularities appearing in both types of systems under a unified framework, presenting 
a classification of singularities into two broad categories. The types of singularities 
which were identified for finite-dimensional cases are compared to those found in driven 
diffusive systems. 
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There are many physical problems in which one is interested in understanding the 
statistics of rare fluctuations. These are often encoded in a large deviation function 
(LDF), or a rate function [H El El II]- For this reason, LDFs have been studied in 
the context of fluctuation theorems n E], dynamics of relaxation processes m E], 
current statistics [91 uni EB Ell US], systems with long-range interactions [H], diffusion 
of tracer particles [T5|, population dynamics [16], condensation phenomena [m EHi 
[T9] , non-equilibrium phase transitions [20], quantum work statistics [2l]) ^ind many 
more. Furthermore, efficient numerical methods for calculating LDFs have also been 


devised [221EB EllESl Eg. 

One class of LDFs which have attracted much attention are those associated 
with density prohles in spatially extended driven diffusive systems out of thermal 
equilibrium [2BEHlE9lEniEIlE2lE3lEl]- In such systems the LDFs are a direct analogue 
of free energies in equilibrium systems. The latter, in driven diffusive systems, can easily 
be shown (see discussions in 2.3) to be local and smooth functions of density profiles. 
In contrast, the former have distinct properties out of equilibrium. First, the LDFs are 
generally non-local functions of density prohles, as might be expected from the presence 
of long-range correlations in bulk-conserving non-equilibrium systems [35l EHI EB EH] ■ 
Moreover, in some models the LDFs are non-differentiable [391 ITOl ITTl IT2] . These singular 
behaviors can be considered as extensions of similar behaviors in systems with a hnite- 
dimensional conhguration space, hrst observed by Graham and Tel [THl ITT] in the weak- 
noise limit, to systems with an inhnite-dimensional conhguration space. In the latter 
the weak-noise limit arises naturally due to the macroscopic system size |45j . 

The aim of this short review is to give an overview of the known results for 
hnite-dimensional systems and those for inhnite-dimensional systems within the same 
framework. As should become clear to the reader, there are singular behaviors in 
hnite-dimensional systems which have not been identihed so far in inhnite-dimensional 
systems. Moreover, the LDFs in inhnite-dimensional systems can exhibit behaviors that 
are richer than the hnite-dimensional counterparts. This leaves much room for further 
studies. 

To this end, we provide a classihcation of the known singular behaviors of hnite- 
dimensional systems, so that the recently found singularities in inhnite-dimensional 
systems can be put in the context of the former. We also pay special attention to the 
duality between a weak-noise system and a Hamiltonian system, whose implications on 
singular LDFs were discussed in great details for hnite-dimensional cases but less so for 
inhnite-dimensional ones. This sheds new light on the physical meaning of the “order 
parameter” that appears in the descriptions [TTl IT2] of singular structures observed in 
inhnite-dimensional systems. 

This review deals only with theoretical aspects of singularities shown by LDFs of 
density prohles or, more generally speaking, system conhgurations. For a review of 
experimental aspects of this subject, see [T6]. We note that LDFs of other variables 
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also exhibit singularities, whose properties and origins are generally different from those 
of the singularities discussed in this review. For example, LDFs of the steady-state 
current may exhibit singularities associated with dynamical phase transitions, even 
though the LDFs for density profiles remain smooth. An interested reader is referred to 

[m iSl HU IM|. 

This review is organized as follows. In section we provide the general formalism 
for finite-dimensional systems in the weak-noise limit, describing how their LDFs can 
be obtained from the associated Hamiltonian structure. Based on this formalism, in 
section we discuss different scenarios that give rise to singularities of these LDFs, 
listing relevant studies for each scenario. Section gives a review of singular behaviors 
found in driven diffusive systems, emphasizing how they fit into the general framework 
set up by finite-dimensional cases. A summary and an outlook for future works are 
given in section 

2. General formalism 

2.1. The Hamiltonian structure of weak-noise systems 

2.1.1. Equations of motion We consider a system whose configuration is represented 
by an n-component vector p = (pi, p 2 , • • •, Pn)- The system evolves in time t according 
to the Langevin equation 

Pit) = F[p{t)] + G[p{t)]r]{t), (1) 

where F = (Fi, F 2 , ..., F„) denotes a deterministic drift force, r] = (pi, 772 , ■ ■ ■, Vm) an 
m-component noise of the environment, and G an n-by-m matrix. While for equilibrium 
systems F and G are related by a fluctuation-dissipation relation, here no such relation 
is assumed; at the moment, we only assume that all elements of F and G are smooth 
(i.e. infinitely differentiable) functions. In addition, we assume 77 to be a Gaussian 
white noise with 

iVuit)) = {v^^it)vAt')) = N-^6i,J{t - F), (2) 

so that the noise amplitude is proportional to Our interest lies in the large N 

limit. 

In the noiseless case, the system evolves through the deterministic dynamics 

Pit) = F[p{t)]. (3) 

We are interested in cases when the solutions of this equation approach the limit sets 
(e.g. attractors, repellers, saddles) denoted by Fi,F 2 ,... as f —)• ± 00 . The attractors 
among these limit sets correspond to the (meta)stable states of the system. If the noise is 
very weak but nonzero (A^“^ ^ 1), then we expect a steady-state distribution satisfying 
the large deviation principle 

Fs(p) ~ exp[-Ar0(p)], 

with local minima of the LDF 0 coinciding with the attractors of (|^. 


( 4 ) 
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A rigorous proof of Q is beyond the scope of this review, and the interested reader 
is referred to [5l] . Here we give a heuristic description of how the LDF (j) is obtained. We 
start by writing the propagator P(/9f, ff|pj, fi) in a path integral form. The propagator 
is obtained by summing the probability of every trajectory p{t) satisfying the Langevin 
equation Q and the boundary conditions p{ti) = p; and p(tf) = Pf, as expressed by 

rp(ti)=Pi 




' pdi)=Pi 


VpJip)6ip-F-Grj) 


(5) 


Here (■)^ denotes the average with respect to the distribution of 77, and J 7 ’(p) the 
Jacobian for changing the variable of integration from p — F — Grj to p. While J (p) 
depends on the discretization (e.g. ltd or Stratonovich) of the Langevin equation Q, it 
always has the form exp [0(1)] (e.g. J{p) = 1 for the ltd discretization) [52]. Thus, in 
the large N limit, the differences between the ltd and Stratonovich schemes are irrelevant 
to the LDF given by (|^. We can therefore neglect J{p) and evaluate the average (■)^ 
to obtain 


P(Pf,ff|Pi,fi) = 


rp{tt)=Pt / r 

/ T^[P, P] S{p-F - Gt]) exp ( -N j 

J p{ti)=pi V Jti 


2 


i'Pik)=Pt 


' p{tC)=Pi 


T>[p] exp 


-N 


'ti 


'' dt^{p-F)-x-\p-F) 

' -V-- 

=L{p,p) 


( 6 ) 

( 7 ) 


Here the n-by-n matrix y = G^G is assumed to be a positive-dehnite matrix, which is 
thus invertible. In the large N limit, we can apply the saddle-point method to obtain 

P{Pi,t{\pi,ti) ~ exp[-iV^(pf,ff;Pi,fi)], (8) 


where we introduced a function dehned by 

Hi 


rn 

S{pf,tf]pi,ti) = mm dfL(p,p), 

Pit) Jti 


(9) 


with the minimum taken over all trajectories p{t) satisfying the boundary conditions 
p(fi) = Pi and p(tf) = Pf. We observe that (|^ has the form of a least action principle 
whose Lagrangian is L(p, p). Introducing the momenta p = {pi, p2,..., Pn), whose 
components are dehned by = dL/dp^, we can rewrite the least action principle as 

H{ 


>5(PfPf;Pi,ti) = min 
pit),pit) 


df [p ■ p - P(p, p)], 


( 10 ) 


( 11 ) 


where the Hamiltonian is given by the Legendre transform 

H{p, p) = p ■ p - L(p, p) = p • P(p) + ^p ■ x(p)p. 

This conversion to a Hamiltonian picture can also be done within the path integral 
formulation using a Hubbard-Stratonovich transformation or the Martin-Siggia-Rose 
(MSR) procedure [53] IS] |55l |56|. See Appendix A for details about the latter. 
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The least action principle of (10) indicates that the propagator is dominated by 


locally minimizing trajectories which satisfy the following Hamilton equations 

x{p)p, 


■ dH , 


P = 


OH 

dp 


n 

E 


Pv 


dFfj_ 1 ^ ^ dXfiv 

11=1 U =1 


(12 a) 

(126) 


We note that if p = 0, these equations describe the noiseless dynamics of (|^. Thus, the 
momenta p represents the effects of noise on the minimizing trajectories. We also note 
that these equations by themselves describe trajectories extremizing the action rather 
than minimizing it. Thus, when referring to the general solutions of (12a), (126), we 
shall use the term extremizing trajectories, from which locally minimizing trajectories 
must be distinguished. 

So far, we have shown that there is a correspondence between the weak-noise limit 
of the Langevin equation ([^ and a Hamiltonian system governed by (12a) and (126). 
We next turn to the structure of the solutions of these Hamilton equations. 


2.1.2. Structure of solutions To make our discussions more intuitive, we consider an 
example of the Langevin equation ([^ given by 

F(p) = -V"(p)=p-p=, X'(p) = l, (13) 


which describes an overdamped Brownian motion inside a double-well potential V (p) = 
- p^/2. Applying 0. the weak-noise limit of this system is described by the 
Hamiltonian 


HiP,p) = P{P- P^) + 


whose corresponding equations of motion are obtained from (12a) and (126) by 
p = p-p’ + p, p = p(3p^-l). 


(14) 

(15) 


Figure shows the phase-space trajectories traced by solutions of these equations. We 
make a few observations on the structure of these solutions, which are generally true for 
any Hamiltonian system satisfying (12a) and (126). 


(i) The limit sets of the Hamiltonian system contain the limit sets of the noiseless 
dynamics, because the latter can be obtained from the former by putting p = 0. 
For example, denoting a point in the phase space by (p, p), ( |l5) ) has three limit 
sets Fi = {(—1,0)}, F2 = {(0,0)}, and F3 = {(1,0)}, which are shown in £gure[^ 
These limit sets are also the limit sets of the noiseless dynamics represented by 
the trajectories on the p = 0 line, for which Fi and F3 are attractors and F2 is a 
repeller. Note that while all the limit sets mentioned here are points, in general 
they may be higher-dimensional objects such as periodic orbits or limit cycles. 
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Figure 1. Phase-space trajectories of the Hamiltonian system satisfying (13). Dashed 
(thick solid) lines represent the trajectories of non-zero (zero) energy. Directions of 
motion are indicated by arrows. 


(ii) The Hamiltonian system does not have any pure attractors or pure repellers. This 

is a general property due to Liouville’s theorem, which states that the area of 
the phase space is preserved by Hamiltonian dynamics. As hgure [T] shows, the 
attractors Ti and Ta (repeller r2) of the noiseless dynamics are repulsive (attractive) 
for “noisy” trajectories with p ^ 0. Thus, the system can escape from any limit 
set towards a neighboring limit set. Recall that this Hamiltonian dynamics is 
derived in the N ^ oo limit, which implies that the evolution from one limit set 
to another requires an inhnite time limit (ti —?• —oo or tf —)• +oo). This allows 
us to dehne a directed graph Q whose edge set E{Q) contains an edge (a —)■ /S) 
if there is such a trajectory from Tq, to T^j. We may call a an in-neighbor of 
[3 and (3 an out-neighbor of a, denoting the relationships by a G N~{(3) and 
f3 G respectively. For example, we can construct a graph with the edge 

set E{Q) = {(1 —2), (2 —)■ 1), (2 —)■ 3), (3 —?• 2)} from the trajectories shown in 
hgure While the noiseless trajectories produce the relations N'^{2) = {1, 3} and 
Ar“(l) = Ar~{3) = {2}, the noisy trajectories give rise to the inverted relations 
AT-(2) = {1,3} and Af+{1) = A^+(3) = {2}. 

(iii) Trajectories going through the limit sets of the noiseless dynamics have “zero 
energy” in the sense that the Hamiltonian stays zero along these trajectories (thick 
solid lines in hgure [^. The Hamiltonian of the form ( [IT| ) is not explicitly dependent 
on time, so all trajectories of the Hamiltonian system are conhned to a surface of 
constant energy. Since the trajectories going through the limit sets have p = 0 at 
some point, their constant energy must be zero. For example, hgure shows that 
the trajectories connecting diherent limit sets must satisfy p = 0 or p = 2(p^ — p). 
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both implying H{p,p) = 0 by (14) 


(iv) Trajectories with nonzero energy accumulate an indefinitely large positive action 
in the limit U —)■ —oo or t{ —)■ +oo. Using ([^ and (12a), the action defined in (|^ 
can be rewritten as 

/•tf 1 

(16) 


= min / 

pW Jti 


dt - P ■ x(p)P, 


where the minimum is taken over trajectories of p satisfying (12a) and {12b) 


Since x is positive-definite, the Lagrangian is zero only at p = 0 and otherwise 
positive. Since trajectories with nonzero energy always have p 7^ 0 (even in the 
limit t —>■ ±cx)), the action (|^ associated with these trajectories keeps increasing in 
time without any upper bound. On the other hand, trajectories with zero energy 
have limit sets satisfying p = 0. Therefore their action saturates to a finite value 
in the limit ti —)■ —cx) or U —>■ -|-cx). 


2.1.3. Evaluation of the LDF With these observations, a method for evaluating the 
LDF 0 can be derived. For any time interval bounded by ti and tf, the steady-state 
distribution Ps(p) satisfies 


P.(P) = / dp,P(p,(r|p„(|)P.(Pi)- 


(17) 


Using 0 and ([^ with the saddle-point approximation, this equation can be rewritten 


as 


(j){p) = min [0(pi) + S (p, tf, Pi, ti)] 

Pi 


(18) 


As is clear from (16), we always have S{p,tf p-^tf) > 0. Thus (18) is consistent with 


our previous statement that the attractors of the noiseless dynamics correspond to 
local minima of 0. Before proceeding further, we note that as far as quantities derived 
from the action are concerned, any pair of configurations on the same limit set can be 
regarded as completely equivalent to each other. This is because such configurations are 
mutually accessible by trajectories with p = 0, which do not cost any action according 


to (10) and (16). Thus, whenever a configuration belonging to a limit set Fq appears 


in the argument of an action-related quantity, we can replace the configuration with F^ 
without any ambiguities. 


We choose U = —00 and U = 0 for (18), which conveniently limits the relevant 


trajectories to those with zero energy; trajectories of nonzero energy, as previously 
observed, cost an infinite positive action. Therefore, only trajectories of zero energy, 
whose initial configuration p, approaches the limit sets of the noiseless dynamics, can 
possibly minimize the action. We introduce a notation a G N'~{p), which indicates that 
the limit set F^ is reached from p in the limit t, -f- — 00 . Then we can rewrite (IT^ as 


0(p) = min [0(Fc,) + S{p, 0; F„, -cx))] , 

aeAf-(p) 

which still leaves the values of 0 on the limit sets undetermined. 


( 19 ) 
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In order to fix the values of the LDF cj) on the limit sets, we use the fact that in the 
steady state 


dp' P{p',tf\p,ti)Ps{p) = f dp' P{p,tf\p',ti)Ps{p). 
o'^o J o'^o 


( 20 ) 

Ip'j^p J p'j^p 

In other words, the probability flux out of p must cancel the probability flux into it. 
This time we use the prescription = —oo and ff = +cx), which ensures that p and p' 


are a pair of neighboring limit sets, as discussed in point (ii) of 2.1.2 Thus, we obtain 

(?!)(ro)+ min [S'(r^, cx); r„,-cx))] = min [0(r^) + ^(ra, cx); T^,-cx))] , (21) 

/3eA/'+(a) g&N-{a) 

which provides self-consistent relations for the values of 0 on the limit sets (see also 


Chapter 6 of [51] for a more rigorous discussion). Combining (19) and (21), we can 
determine 0 for any point in the conhguration space up to an undetermined global 
additive constant. The constant can be set by choosing the global additive constant so 
that 0(r*) = 0 at the global minimum of 0, where T* corresponds to the most probable 
state of system. 


2.2. Alternative approach: Fokker-Planck equations 

It is instructive to see that the same results can also be derived by noting that the 
Langevin equation ([^ is equivalent to the Fokker-Planck equation 




0 . 1 


8^ 


‘2N ^ dp^dp, 


-Xpuip) 


Pip,t). 


( 22 ) 


When the system reaches the steady state, we may use the large deviation principle 
given by (|^ in place of P{p,t)- Leaving only the leading-order terms, we obtain 


^ , 00 1 00 / \ 00 


(23) 


A comparison with the Hamiltonian dehned by ( pT| shows that this equation can be 
rewritten as 


H 




(24) 


which can be regarded as a Hamilton-Jacobi equation for zero energy [57]. This 
interpretation allows us to apply the standard formalism of analytical mechanics, which 
assigns the meaning of an action (possibly modihed by an additive constant) to 0 and 
introduces momenta by the relation 
00 


P = 


dp 


(25) 


This relation is consistent with (19) if p is interpreted as the hnal momentum of 


a trajectory that starts from a limit set and dominates 0. Proceeding from this 
interpretation, we can derive the Hamiltonian structure previously discussed. 









Singularities in large deviation functions 
2.3. Systems with detailed balance 


9 


If the system is in equilibrium and thus satishes detailed balance (DB), its LDF 0 can be 
obtained in a simpler way. For the sake of simplicity, we assume that all system variables 
are even (i.e. do not change sign) under time reversal. Given this assumption, DB 
requires that the flux of probability between any pair of (possibly equal) conhgurations 
p and p' satishes |58] 

(26) 


P(p',U\P,t\) Ps(p) = 


We consider the case of U = t\ + dt with dt 1, so that the system evolves only for 
an inhnitesimal time interval. Due to the large deviation principle (|^, the steady-state 
probability of p' can be written as 


Psip') ~ exp[—A^0(p')] ~ exp < —N 


,, , d(p . . 


(27) 


Meanwhile, the “forward” propagator from p to p' in the LHS of (26) is given by 
with the action evaluated by the constraint of zero energy. Thus, we obtain 

F(p',ff|p,fi) ~ exp{-iVp ■ pdf} , (28) 

where p = (p' — p)/df and p satishes the equation of motion (12a). The “backward” 
propagator from p' to p in the RHS of (26) can be obtained in a similar way, after 
applying appropriate time reversal operations p —)■ —p and p —)■ p"*"^ so that the time- 
reversed equation of motion 

-p = F(p) + x(p)p™ (29) 

is satished. Then, in a manner similar to ( [2^ , we have 

F(p, tf Ip', fi) ~ exp [N'p ■ p™ dt} . (30) 

), we obtain 

(31) 


Using ([2^, (pSj), and ([^ in 


9(j) . . tr 

= P + P . 

op 


This expression may appear to contradict (25), but (31) is about trajectories between 
any pair of nearby conhgurations p and p', while in (25) p is the hnal momentum of a 
trajectory from a limit set. From (12a) and (29), we rewrite (31) as 


^ = -2x 

dp ^ 


-1 


ip)Fip). 


(32) 


The LDF 0 can be determined simply by integrating the RHS of this equation. We note 
that (32) is a sufficient condition for the Hamilton-Jacobi equation (24), which conhrms 
that (32) is indeed consistent with the Hamiltonian structure discussed above. Moreover, 
since we have already assumed that y and F are smooth and that y is invertible, (32) 
implies that (j) is also a smooth function. 

The above results can be easily generalized to cases involving odd-parity variables. 
See [59l [601 El] for general approaches based on the Fokker-Planck equations. 
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If a system is out of equilibrium, the DB condition (32) is not satisfied. Then, even 


if F and G are smooth, the LDF of the system is not necessarily smooth in the weak- 
noise limit; it is well known that the function may have singularities [SHI EHl El]- For 
finite-dimensional systems, the origins of such singularities are well understood from the 
Hamiltonian structure discussed in section Broadly, there are two major scenarios 
which lead to singular LDFs. The first originates from the existence of multiple limit sets 
in the system. In this case there are generically several locally minimizing trajectories, 
each originating from a different limit set, which lead to the same final configuration 
with the globally minimizing one dictating the LDF (see below). As the configuration 
is changed, the locally minimizing trajectories change smoothly. However, there are 
specific points where the globally minimizing trajectory changes by originating from 
a different limit set. This, much like a usual first order phase transition, leads to a 
singular LDF. In a second scenario, locally minimizing trajectories originating from the 
same limit set compete and lead to a singular behavior. In this case a singular LDF 
appears as a bifurcation, and for reasons that will become clear later we refer to these 
as Landau-like singularities. 

In the following we discuss how each of these scenarios gives rise to singularities in 
finite-dimensional systems. We also touch upon other types of singularities that arise 
in more exceptional cases. 


3.1. Singularities due to multiple limit sets 


As expressed in (19), the LDF (f is evaluated by choosing the limit set that minimizes 
its value. As discussed above, in the presence of multiple limit sets, a singularity of (f 
can occur at points where the minimizing limit set changes abruptly as p is continuously 
varied. 

We present a simple example of such singularities, which is adapted from p2] . 
Consider an overdamped particle on a one-dimensional ring, whose position p evolves 
according to the Langevin equation 

P = f -V\p)+r]it). (33) 

Here / > 0 is a constant force, V a smooth periodic potential, and rj a Gaussian white 
noise satisfying (ri{t)rj{t')) = 2N~^5{t — t'). See figure|^for an illustration of this system. 
We assume that the effective potential U{p) = —fp -\- V{p), represented by the gray 
curve in figure satisfies U'{p) = 0 only on two points A and B with U''{A) < 0 
and U"{B) > 0. Thus, A (B) is the attractor (repeller) of the noiseless dynamics 


corresponding to (33). 


In the large N limit, the system is related to a mechanical system characterized by 
the Hamiltonian 


fUp.p) = -pU'(p) + p\ 


(34) 
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Figure 2. A simple model with a singularity of the LDF due to multiple limit sets. 
The gray curve represents the effective potential U, and the black curve shows the 
LDF (j) (see the main text for definitions). For the flat portion of the trajectories to 
the right (marked by dashed arrows) are less costly than those to the left in terms of 
action. 


which indeed has the form of 0 - As discussed in |2.1.3| only trajectories with 


H{PiP) = 0 contribute to the LDF. Thus, we can limit our attention to two types of 
trajectories given by p = 0 and p = U'{p). “Downhill” trajectories from B correspond 
to the former and do not cost any action, satisfying S{pi, 0\B, —oo) = 0. On the other 
hand, “uphill” trajectories from A belong to the latter type, whose action is given by 

pO ppi 


S'(pf, 0|A, —oo) = / dtpp= dpU'{p)>0, (35) 

J — OO J A 

where we used the zero-energy constraint for the first equality and used the substitution 


pdt = dp for the second. Using (21), we can fix the difference between (j){A) and (j){B) 
by 


4>{B) = 0(A) -b min 


i dpU\p), / dpU\p) 
Uacb Jab 


= ■#>(■4)+/ dpU'{p), 


(36) 


'AB 


where ACB {AB) represents the trajectory from A to B that is headed to the left 
(right). As is evident from figure]^ the trajectory AB costs less action and dominates 
the LDF. Since A is the most probable position, we fix the zero point of the LDF by 


setting 0(A) = 0. Finally, the LDF at any position pf is determined from (19) as 
0(pf) = min 


r-pf 


(37) 


dpU'(p), / dpU'(p) 

IJ AB Ja 

Note that each option corresponds to a different limit set: the first to B and the second 
to A. As shown in figure there exists a point C at which the minimizing limit set 
changes, so that the LDF has the form 


0(Pf) = 



dpl7'(p) if pf is between B and C 

dpU'{p) otherwise 


(38) 


as represented by the black curve in figure Then the first derivative of 0 has a 
discontinuity at C. This singularity reflects the fact that the barrier on the left is larger 
than the barrier on the right, which makes it easier to reach the interval between B and 
C by trajectories going to the right, which are marked by representative dashed arrows 
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in figure It is easy to verify that this singular behavior is lost for / = 0, i.e. when 
the system is in equilibrium. 

The same type of singularities have been found in various model systems. An 
exactly solvable model studied by [63l [M] has a separable angular degree of freedom, 
whose singular behavior is essentially the same as that of our example. Similar examples 
are also discussed in [65]. An underdamped counterpart of our example, which models 
a dc-biased Josephson junctions and charge density waves, was also found to have a 
line of singularities separating a stable hxed point from a saddle point or a stable 
limit cycle [62l [66|. In addition to these periodic systems, a non-equilibrium system 
with symmetric double wells [SZl ESI EH ED] also exhibits such singularities along the 
boundary between the two basins of attraction. 

Singularities due to multiple limit sets are generally of a hrst-order nature; the hrst 
derivative of the LDF is singular. In what follows we discuss other kinds of singularities, 
which turn out to have a structure analogous to phase transitions described by a Landau 
theory. 


3.2. Landau-like singularities 


3.2.1. Bifurcation of locally minimizing trajectories Even if the system has a single 
limit set, the LDF may still possess singularities. In principle, a single initial limit set 
(even in the case when it is a hxed point) can give rise to multiple locally minimizing 
trajectories that reach a hnal conhguration pf. When such cases arise, the least action 


principle (10) picks the trajectory with the minimal action as the globally minimizing 


trajectory that determines the LDF. As pf is continuously varied, the globally minimizing 
trajectory may switch abruptly from one to another, creating a boundary on which 
multiple globally minimizing trajectories coexist. The LDF becomes non-differentiable 
on such boundaries. As we show below, this can only occur when pf is far enough from 
the initial limit set, so that there is a bifurcation of locally minimizing trajectories at 
some “threshold” of pf. 

To provide intuition into how such bifurcation can occur, we present a simple 
example: a discretized version of a transport model between two reservoirs [22] which 
is known to exhibit this type of singularities in driven diffusive systems im. Consider 
a two-component system described by the density variables pi and p2, which exchange 
current with each other as well as the reservoirs of densities that are respectively hxed at 
Po and ps [see hgure|^a)]. We assume that the current between neighboring components 
huctuates so that pi and p2 evolve by the Langevin equations 

Pi = Po — 2pi + P2 + O'0l(P0, Pi) hoi — 0‘l2(pi, P 2 ) P12-, 

P 2 = pi — 2p2 + Ps + ij(^i 2 {pi, P 2 ) V 12 — ij <^ 23 (^ 2 , Ps) V 23 , 
where the noise amplitudes satisfy 

fUPi., Pi-) = l + (Pi. + Pi-)^. - i') 


(39) 


a 


(40) 
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P 1 +P 2 


Figure 3. (a) A two-component boundary-driven system described by (39). (b) The 

extremizing trajectories (gray curves) originating from the stable fixed point (black 
point), which are obtained from the Hamiltonian (41) with p = 1. A pair of red points 
(lines) indicate the bifurcation points (switching lines). 


for any two indices /i and u. In the absence of noise, the system relaxes to the stable 
hxed point at ^ po+^ps )^ which is the only limit set of the dynamics. It is easy 

to verify that as long as po 7^ pa the system carries a cnrrent and is ont of eqnilibrium. 
For simplicity, we consider the special case when the reservoirs satisfy pa = — po = p, 
which drives the system ont of equilibrium but still maintains some symmetry. Then, 
the Hamiltonian describing the large N limit of this system is obtained from ([IT|): 


Hip, p) = Pi (P2 - P - 2pi) + P2 (pi + p - 2p2) 

+ 2 di [1 + (Pi ~ PY] + 2 ~ P2Y [1 + (Pi + P2Y] 2 

The corresponding equations of motion can be obtained from ( |12a ) and (12b), which 
can be solved numerically and together with the least action principle (10) give rise to 
the extremizing trajectories shown in hgurej^b). The trajectories show that, if the hnal 
conhguration p^ is on the line P 1 + P 2 = 0 and sufficiently far away from p^, there are two 
histories deviating from pi + p2 = 0. By evaluating the action accumulated during each 
history, one can see that these histories indicate a pair of globally minimizing trajectories 
from p^ to Pf. The collection of Pf with multiple globally minimizing trajectories form 
two semi-inhnite lines, as marked by the red lines in hgurej^b). These lines, often called 
switching lines, indicate the boundaries on which the globally minimizing trajectory 
switches abruptly. Meanwhile, if Pf satishes pi + P2 = 0 but is close enough to p^,, 
there is only a single globally minimizing trajectory that stays on the straight line 
Pi + P 2 = 0. This can be understood by noting that close to p^ the equations of motion 
can be linearized. The solutions of the linearized equations can never lead to coexisting 
trajectories. 

The origin of the bifurcation can be intuitively understood from the form of the 
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P± 


Pii(^) 



Pi(0 


Figure 4. Geometric interpretations of the parameters appearing in the Landau free 
energy (43). The red solid line represents the switching line. 


Langevin equation (39). The excitation of the system along the line pi+ p 2 = 0 requires 


that pi and p 2 evolve in opposite directions, which is efficiently driven by the noise 
component 7712 thanks to its opposite signs in (39). Note that the amplitude cri2 of 
7712 is minimized along the line pi + P 2 = 0. Thus, introducing a small deviation 
from Pi + P2 = 0 along the trajectory increases the driving provided by 7712, which 
for sufficiently far away P{ may reduce the action despite the increased length of the 
trajectory to the hnal conhguration. Deviations in both pi + P2 > 0 and pi + P2 < 0 
directions have a symmetric “boost” of the drive, so the globally minimizing trajectories 
have a reflection symmetry with respect to the pi + P2 = 0 line. 

This example indicates that the end point of a switching line indicates the point at 
which different locally minimizing trajectories start to bifurcate. The structure of such 
bifurcations can be described by an analogue of a Landau theory, which we now discuss 
in more detail. 


3.2.2. Formulation of the Landau theory We present a phenomenological formulation 
of the Landau theory for trajectory bifurcations. We assume that the system has a 
unique stable hxed point and that locally minimizing trajectories from start 
to bifurcate when the hnal conhguration is at p^. It is convenient to introduce new 
coordinates (p||,p±) for the conhguration space, so that the origin is located at p^, the 
positive p||-axis coincides with the switching line, and the p_L-axis is perpendicular to 
the switching line. If there are multiple possible axes perpendicular to the py-axis, the 
p_L-axis is chosen so that it represents the direction in which trajectories move away 


from each other as they bifurcate. In the example of (39), the py-axis runs parallel to 


the lines of constant pi + P 2 , and the py-axis is parallel with the lines of constant pi — P 2 . 

Let Pi(t) and Puit) denote (possibly identical) locally minimizing trajectories 
reaching the final configuration (py,p_L). We define 


avg 


(t) = + ^ n(^) 

^ ’ 2 


Sp(t) ^ ^t ) -T.Pn(4 




where ||(5p(f)|p = J^^dt 6p{t)-6p{t). See hgurej^for an illustration of these trajectories. 
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With these dehnitions, we formulate a Landau free energy £(g; p\\, p±), so that the order 
parameter q minimizing C captures the behavior of ||(5p(f)||, which becomes zero before 
the bifurcation (py < 0) and nonzero after the bifurcation (py > 0). More specihcally, 
we consider q that satishes q ~ ||(5p(t)|| close to the bifurcation (see hgure |^. The 
appropriate form of C is 


py, p±) = C4g^ - capyg^ + p±g, (43) 

where C2 and C4 are positive coefficients. Using the condition that C must be minimized, 
we obtain a “phase diagram” in the (py,p_L)-space, as shown in hgurej^b). For py > 0 
and p\ < (8c2Py)/(27c4), there exist two different local minima of £, which indicates 
the presence of multiple locally minimizing trajectories in the region. Interpreting 
these trajectories as “metastable states”, the boundaries of the region given by p\ = 
(8c2Py)/(27c4) can be regarded as spinodal lines, which are indicated by the thick black 
lines in hgure [^b). Within the region bounded by the spinodal lines, both locally 
minimizing trajectories have the same value of C on the switching line p_L = 0 (the 
thick red line of hgure |^, which indicates that they are equally dominant. The abrupt 
change of the minimizing q as the sign of p± hips across this line means that C has 
a discontinuity in its hrst derivative across the line [see hgure |^c)] , so the switching 
line becomes an analogue of the discontinuous transition line. Finally, the common end 
point of all spinodal lines and the discontinuous transition line at the origin py = p_L = 0 
is naturally interpreted as a critical point. This predicts q ~ py'^^ for the separation 
between bifurcating trajectories for small py. 

We have explained how singularities associated with trajectory bifurcations can be 
described by a Landau theory on a phenomenological level. We note that C can be 
derived more systematically by approximating the path integrals of section close to 
Pj. and integrating them over variables which are not directly related to the trajectory 
bifurcation. See Chapter 15 of UB for details. Such derivations show that the steady- 
state distribution can be written in the form 

Fs(Pf) ~ exp [-N(p{p^)] j dq exp [-iV£(g; py, p^)] . (44) 


Applying the saddle-point method, the value of q must be such that C is minimized. 
From Q, it is clear that the minimum of C is an additive term of the LDF 0. Therefore 
any singularity arising from the minimization of C captures the singular behavior of 0. 

Finally, we note that (43) is not the only possible form of C. Depending on 
the system, the trajectory bifurcation may involve more than two globally minimizing 
trajectories, in which case it is better described by the Landau theory of multicritical 
points. Catastrophe theory has developed a series of standard forms of C, among which 
(43) is a special case usually referred to as a cusp catastrophe [72]. We will see later 
that there are indeed models whose Landau-like singularities are described by the other 
forms of C. 


3.2.3. Connections with Lagrangian manifolds Landau-like singularities are related to 
a nontrivial geometry of a manifold in the phase space which is formed by zero-energy 
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trajectories. This is referred to as a Lagrangian manifold (LM). More specifically, the 
relevant LM is formed by trajectories originating from an attractor, called an unstable 
LM. The strnctnre of the nnstable LM provides a deeper nnderstanding of the patterns 
of extremizing trajectories close to a Landan-like singularity. 

A simple example of such LM can be obtained from (44). We observe that C plays 
the role of an action, whose minimum value contributes to the LDF <f. The momentum 
p± conjugate to the coordinate p± is 

d 


P± = 


dp± 


>C(g;P||,p±) = q. 


(45) 


This allows us to interpret the order parameter as a momentum component associated 
with a direction perpendicular to the switching line. Note that the other momentum 
component, 

d(j) 


P\\ 


9p\\ 


= -C2q 


(46) 


is equal for any pair of two globally minimizing trajectories meeting on the switching 
line. Thus, p± is the only momentum component that differs between coexistent globally 
minimizing trajectories at the hnal time. From the condition dC/dq = 0 for the 
minimization of £, we obtain 


Pi ^ 2c2P||Pi - 


(47) 


which gives the structure of the LM close to p^. 

Figure |^a) shows the schematic shape of the LM satisfying ( [4^ . The LM has 
multiple sheets in the region satisfying p\\ > 0 and p\ < (8c2p|)/(27c4); in the rest of the 
conhguration space, the LM is a single sheet. The boundaries p±_ = ±[(8c2p|)/(27c4)]^/^ 
between these two regions, which correspond to spinodal lines, are now fold lines 
indicating where the LM is folded. The extremizing trajectories appear to be reflected 
by these lines when they are projected onto the conhguration space, so the fold lines 
may also be called caustics, in the sense that they form an envelope of the trajectories. 
Between the two fold lines, the upper (lower) sheet dominates the LDF for p_L < 0 
{p± > 0). The boundary between these two regions coincides with the switching line 
p± = 0. The origin py = p± = 0, which was previously interpreted as a critical point, 
coincides with the cusp point formed by the fold lines. 

Note that the middle sheet never plays a dominant role, which has an important 
implication on the structure of the globally minimizing trajectories: any extremizing 
trajectory, after being reflected by a fold line, enters the middle sheet and ceases to 
be dominant. To be more precise, the trajectory is no longer dominant once it crosses 
the switching line, which occurs always before the reflection at the fold lines. Hence, 
while the switching line can be identihed by tracking the abrupt change of the globally 
minimizing trajectories, the fold lines are almost never encountered by the typically 
observable trajectories. This is a notable difference from the caustics appearing in ray 
optics (in the short wavelength limit) and semiclassical quantum mechanics (in the 
small h limit), where the caustics are indeed observable patterns formed by extremal 
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trajectories. In these cases, the action has complex values, so the saddle-point method 
does not impose a minimum criterion in the form of the least action principle 0- 
Without such restrictions, nothing prevents the typically observable trajectories from 
meeting the fold lines |73j . 

Just as the Landau free energy C can have more complicated forms involving 
more parameters, the LM associated with a Landau-like singularity can have a higher¬ 
dimensional structure, which can be obtained from £ by a procedure similar to the one 
discussed above |S7|. Even in these cases, multiple extremizing trajectories reaching 
the same configuration requires that the LM has multiple values of Pf corresponding 
to the same Pf. Thus, the folded geometry of the LM is a minimal requirement for 
a Landau-like singularity. It is known that such a geometry is possible only if the 
Hamiltonian system is non-integrable at zero energy, which allows momenta to be multi¬ 
valued functions of p |S7|. This reveals an important connection between two seemingly 
unrelated subjects, namely the existence of a smooth LDF for a weak-noise system and 
the integrability of the corresponding mechanical system. 

3.2.4- Finite-dimensional models with Landau-like singularities Studies of Landau- 
like singularities in finite-dimensional systems have focused on models with a two- 
dimensional configuration space. These have the minimum required degrees of freedom 
for the existence of such singularities. It is known from catastrophe theory that the only 
structurally stable singularities for such models are cusp points and fold lines; other types 
of singularities are generically impossible. Thus, the main difference between models 
does not lie in the types of singularities, but in the global structure formed by the 
singularities. 

The simplest structure involves only a single cusp point and a pair of fold lines. This 
structure was first identified in a periodically driven nonlinear oscillator by perturbative 
and numerical methods na mi EH izg, whose Landau-like behaviors are even 
experimentally observable [HEZIEH]. See more recent numerical studies [TSlEnilHI] 
for clearer presentations of the structure. For this particular type of systems, it has 
also been studied whether the driving strength has a nonzero threshold for the onset of 
singularities [82] . A time-reversed van der Pol oscillator [HOl EH El] and a symmetric 
double-well system [671 [681 [69l [TOl [771 El] also have a similar structure of singularities. 

A more complicated structure that was identihed has the shape of a tree graph: 
cusp points form the vertices of the tree, and the switching lines become the edges 
of the tree. A simple tree made by three cusp points and three switching lines was 
numerically found in [85l 186] . Larger trees may contain an infinite number of cusp 
points and switching lines, as found in some models with a stable limit cycle [871188] . 
See [HS] for a general theory of such inhnite tree graphs. 
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Figure 5. (a) The typical structure of the LM close to a cusp point. The thin black 
lines with arrows indicate extremizing trajectories, and the thick black lines correspond 
to fold lines, (b) A projection of the LM on the configuration space yields a “phase 
diagram” of coexisting trajectories, in which the thick black lines are spinodal lines 
and the thick red line is the discontinuous transition line, (c) The corresponding LDF 
near the same cusp point has a non-differentiable line (thick red line). 


3.3. Other types of singularities 

There are two types of singularities that occur in more restricted circumstances. They 
do not clearly fall into any of the major categories discussed above. 

The first type behaves like a hybrid of the two major categories. It arises when 
one end of a switching line, on which trajectories from a saddle point and a nearby 
attractor are equally dominant, coincides with the saddle point itself; see [73] for the 
conditions for this to happen. Then the saddle point becomes a singularity similar to a 
cusp point, in the sense that the LDF is trivially differentiable there [dftjdp = p = 0 
on a limit set, as discussed in section and a fold line emanates from it [731 EHl 1^ - 
But the singularity does not satisfy the scaling properties expected from a Landau 
theory, because it is formed by the interference between different limit sets and not 
by a bifurcation of trajectories. This type of singularities are thus called non-generic 
cusps [69] ; they have been found in a few systems with a saddle point on the boundary 
of a basin of attraction, namely a Penning trap [731 EH], a Selkov model [90], and a 
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symmetric double well system without DB [63l EH EHl EH CO] . 

The second type of singularities appear on an attractor and keep the LDF smooth. 
They are encountered when the attractor itself is about to lose its stability by a 
bifurcation involving more than one parameter. See [HI EH EH EH EH ES] . 

4. Singularities in driven diffusive systems 

So far we have discussed singularities of the LDFs in hnite-dimensional systems. It 
is natural to ask whether such singularities, or even more complicated ones, are 
present in spatially extended driven diffusive systems, which have an inhnite-dimensional 
conhguration space. For such systems the weak noise limit is natural (see below). In 
this section, we discuss Landau-like singularities found in these systems, whose origins 
are essentially the same as those of hnite-dimensional cases. To date, these are the 
only ones identihed in driven diffusive systems. We start by showing how the general 
formalism described in section can be applied to driven diffusive systems. 

4 . 1 . Large deviations of driven diffusive systems 

We consider a driven diffusive process of a locally conserved quantity p = p{x,t) in a 
one-dimensional system with a spatial variable x G [0, N]. The generalization to higher 
dimensions is trivial. The process satishes the continuity equation 

dtp + dxJ = 0, (48) 

with the huctuating current J given by 

J(x,f) = -D{p)d^p + a{p)E + ^Ja{p)r]{x,t). (49) 

Here F' is a bulk driving force, and r/ is a Gaussian white noise. Using a diffusive 
rescaling x —)■ N~^x, t —)■ N~‘^t, and E —)■ N~^E, we hnd that rj satishes 

{ri{x,t)) = 0, {ri{x,t)ri{x',t')) = N~^6{x — x')6{t — t'). (50) 

In a thermodynamic limit N —>■ 00 , we naturally obtain a weak-noise problem. Since 
we now have x G [0,1], the spatial boundary conditions can be written as 

p(0)=Po, p{l)=pi. (51) 

We assume that every part of the system is locally in equilibrium, so that the dihusion 
coefficient D and the mobility a are related by the local Einstein relation 

2 D(p) = a(p)r(p), (52) 

where f" is the second derivative of /, the local free energy per unit length, with respect 
to p. We also assume that / is a smooth function. By analogy with (|^, we expect that 
the steady-state distribution satishes the large deviation principle 

Ps[p{x)] ~ exp {-N(j)[p{x)]} , 

where the LDF 0 is now a functional of the spatially extended conhguration p{x). 


( 53 ) 
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As discussed in section the LDF 0 can be obtained from a path integral 
representation of the propagator in a few different ways. For simplicity, we present 
a method based on the MSR formalism below (see Appendix A): 


P[Pi{x),ti\pfx),U] = 


/ v[p,r]]6[p - d^J]exp 

' p(x,ti) = Pi{x) 

ppiix) r ptf I- 

/ '^[p^p^v] exp -N dt 

' Pi(x) L dti Jo 

pPiix) [ ptl 


-N 


dt 


-i ^ 2 - 

, *2- 


da; ( -^ + pdtp- Jd^p 




V[p,p] exp 


-N 


'k 


dp / Axpdtp- H\p,p\ 


(54) 


Here p is a momentum field obeying the boundary conditions p(0) = p(l) = 0. The 
functional H, defined as 


H[p{x),p{x)]= / dx 


-D{p){d^p){d^p) + a{p)Ed^p+ -a{p){d^pf 


(55) 


becomes the Hamiltonian of the system. By the saddle point method, the propagator 
is approximated as 

P [pf(x),ff|pi(x),fi] ~ expl-A^F [pf(x),ff|pi(x),fi]} , (56) 


where S is the minimal action functional which is obtained from 


ptf 


S [pf{x),tf\pi{x),ti] = min 

p{x,t),p(x,t) 


dp / dxpdtp- H[p,p] 


(67) 


This relation is an analogue of the least action principle stated by (10); it implies that 
the propagator is dominated by Hamiltonian trajectories satisfying 

5H 


dtp = 


= d^D{p)da,p - dppa{p)E - da,a{p)d^p, 


Sp{x) 

^tP = -T^ = -D{,p)dlp - a\p)Ed^p - \a\p){d^pf. 


(58 a) 
(586) 


5p{x) ------ 2' 

Note that, unlike the finite-dimensional cases, the noise effects are now represented by 
dxP rather than p itself. This is a consequence of the local conservation of p, which 
ensures that a divergence operator is always attached to the noise term (see (48)). 
Bearing such subtle differences in mind, we can push the analogy further to obtain 
the LDF 0 from the action functionals using the Hamiltonian structure described in 
section |2l 

It is instructive to first consider systems in equilibrium. In this case, we can easily 
obtain a DB condition 

H[p{x)] . , .tr 


5p{x) 


= P + P 


(59) 


which is an analogue of (31). Besides, in equilibrium the most probable configuration p 
satisfies 


D(p)diP + <T(p)E = 0, 


(60) 
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which indicates the vanishing average current (J). Note that p™ gives rise to the 
time-reversed equation of motion 

- dtp = d^D{p)d^p - d^a{p)E - d^a{p)d^p'^^, (61) 


which together with (58a) implies 

a{p) dx{p + p™) = 2D{p)dxp — 2a{p)E + const. 


(62) 


Since both sides must be zero for p = p, the additive constant is equal to zero. From 

(63) 


(52), (59), (60), and (62), we obtain 


-2E = r{p)8^p - rm^p = 4 inp) - fm 


6p{x) a{p) 

Using the zero-point prescription 0[p(a;)] = 0, the LDF is obtained as 
WA] = /di [f(p) - f{p) - f'(p){p - p)]. 


(64) 


This shows that the LDF of an equilibrium system is a local functional of the 
conhguration p(x), that is, the functional is a sum of local contributions (see also [9711^ 
for other discussions on this formula). Since the steady-state distribution given by 


(53) is then a product measure, different parts of the system are uncorrelated. Moreover, 


(64) also shows that 0 is a smooth functional of p(x), as / (or equivalently D and a) 
has been assumed to be smooth. 

None of these properties are guaranteed if the system is out of equilibrium. It 
is known that non-equilibrium systems generally develop long-range correlations (see 
03 for a review), which manifest themselves in non-local LDFs. Such LDFs were 
identified in some exactly solvable cases, e.g. the symmetric simple exclusion process 
(SSEP) [271 EHl EH] and the Kipnis-Marchioro-Presutti (KMP) model [32]. While the 
LDFs of these examples are still smooth even out of equilibrium, there are other examples 
in which the LDFs are neither local nor smooth, as discussed below. 


4 . 2 . Landau-like singularities in boundary-driven systems 

While Landau-like singularities were initially identified in a model with a bulk bias [39] , 
we first discuss those in the absence of any bulk bias (i.e. E = 0). In this case the 
system is kept out of equilibrium by a boundary bias po 7 ^ pi. Then the behavior of 
the system is completely determined by D and a. The precise condition for D and a to 
give rise to Landau-like singularities is yet to be clarified, but there are a few boundary- 
driven models that have been shown to possess these singularities [IQIIIT]. As a concrete 
example, we discuss a boundary-driven Ising (BDI) model in some detail. 

The BDI model is an exclusion process with nearest-neighbor interactions biased 
towards creation or annihilation of domain walls. Consider a one-dimensional lattice of 
sites i = I, ..,n, each of which is either occupied by a particle (1) or empty (0). Each 
particle jumps to an adjacent empty site according to the following rates: 
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Figure 6. The functions D{p) and cr(p) for two boundary-driven models exhibiting 
Landau-like singularities: (a) the BDI model and (b) the transport model with a 
quadratic a. 



Figure 7. Snapshots of two globally minimizing trajectories of the BDI model leading 
to the same pf. 


with the same rates for the left-right inverted configurations. It is known that these 
rates lead to an Ising-like steady-state distribution at equilibrium [99]. In the continuum 
limit, the model is described in terms of the particle density prohle p{x) that evolves 
according to (48) and (49), with D and a determined by the parameter set (e, 5) [4511^ . 
Figure a) shows numerical calculations of these functions for (£,5) = (0.05,0.995). 
Note that D has a peak and a has a local minimum around p = 1/2. A class of 
boundary-driven models with this type of D and a are called the Katz-Lebowitz-Spohn 
(KLS) model with zero bulk bias [99]. It is easy to check that the model has only one 
stable conhguration p. 

Numerical studies [4Ul I4T] showed that the BDI model has two globally minimizing 
trajectories for some hnal conhgurations, which form a multi-dimensional “switching 
surface”. For the convenience of visualization, we focus on the singular behaviors within 
a two-dimensional subspace of hnal conhgurations satisfying 

Pf(x) = p{x) + aisin(7ra:) -|- 0:2 sin(27ra:). (66) 


The subspace is spanned by varying the coefficients ai and 0 : 2 , which also have one- 
to-one correspondence with the conhguration components p{x = 1/3) and p{x = 2/3). 
An example of two globally minimizing trajectories is shown in hgure in which one 
trajectory (blue solid lines) starts by raising the total number of particles, while the 
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Figure 8. A cusp singularity of the BDI model, (a) The cross section at p(l/3) and 
p(2/3) of the globally minimizing trajectories shown in figure]^ (b) The switching line 
(dashed line) with contours of f (solid lines). 



Figure 9. (a) The function {Sq — Sq=o)/A^ as a function of y at pj_ =0 and 

P|| = 0.012 (solid line). A deviation is seen from a fit to a quartic function (dashed 
line), (b) The function {Sq — Sq=o)/ for different values of py (dashed lines). Fitting 
the functions including y®, y® terms and plotting only the quartic part, the collapse 
improves significantly (solid lines). 


other (green dashed lines) initially lowers the number. Cross-sections of these same 
trajectories at p{x = 1/3) and p{x = 2/3) are shown in £gure|^a), which clearly shows 
the different routes taken by the trajectories in the conhguration space. In agreement 
with hnite-dimensional cases, such trajectories form a pattern in the conhguration space 
associated with a cusp singularity: as shown in hgurej^a), there is a region (shaded area) 
of multiple extremizing trajectories bounded by fold lines (solid lines), and an abrupt 
change of globally minimizing trajectories occurs across the switching line (dashed line). 
The contour lines of </>, shown in £gure|^b), clearly indicate that </> is non-differentiable 
along the switching line. 

To check whether the cusp singularity is indeed described by a Landau free energy 


of the form (43), one can numerically estimate the action Sg accumulated by a trajectory 
of the form 


p{x,t) = p^yg{x,t) + qu{x,t), 


(67) 


where Pa.vg{x,t) and u{x,t) are dehned from extremal trajectories as in (42). The final 
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q 1 
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Figure 10. An illustration of the PASEP. Particles hop one site to the right (left) 
with rate 1 (g) if the adjacent site is empty. On the left (right) boundary particles 
enter with rate a (6) and exit with rate 7 (/3). 


configuration pf is assumed to be on the switching line (i.e. p± = 0 ) and very close to 
the cusp point (i.e. p\\ 1). If A is the value of q minimizing the action and y = g/A, 

we can write 


Sn — Sq=0 




( 68 ) 


If this scaling form is able to collapse the action functionals estimated at different 
locations of pf, we can conclude that the prefactor of [corresponding to C 4 of (43) 


is a hnite constant, which conhrms the applicability of the Landau free energy (43). 


Figure a) shows that a quartic £t by ( [ 68 | approximates the behavior of the action 
to some extent, albeit with deviations due to higher-order terms. The data collapse 
is shown in £gure|^b), which indicates that including higher-order terms in the curve 
htting (solid lines) improves the data collapse compared to the quartic hts (dashed 
lines). Thus, we can conclude that the cusp point of the BDI model is indeed described 


by a Landau free energy (43) 


Another boundary-driven model, represented by D{p) = 1 and a{p) = 1 -|- 


see 


hgure l^b)], was found to exhibit a cusp singularity [H] (note that this model is a 


spatially extended counterpart of the example discussed in 3.2.1). In both boundary- 


driven models the ratio u/D, which is related to the compressibility k by the fluctuation- 
dissipation relation a{p)/D{p) = 2kBTp‘^n{p), has a local minimum. Numerical results 
suggest that a sufficiently deep local minimum of a/D may indeed be a condition for 
the existence of singularities; however, it is still unclear how such a structure of a/D is 
connected to the form of the action giving rise to trajectory bifurcations |TT] . 

We also note that only cusp singularities have been identihed in boundary-driven 
systems. More complicated singularities were found in systems with a bulk bias, which 
we discuss next. 


4-3. Landau-like singularities in bulk-driven systems 

The only bulk-driven model that is known to possess a singular LDF is the partially 
asymmetric simple exclusion process (PASEP). The model is dehned on a one¬ 
dimensional lattice with N sites (see hgure 10). Each particle on the lattice hops one 


site to the right with rate 1 and to the left with rate q provided that the site that it hops 
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to is vacant. For boundary sites 1 and N, a particle enters (exits) the lattice at site 1 
with rate a ( 7 ) and at site N with rate 5 (/3) if the boundary site is vacant (occupied). 

The continuum limit of the model is described by (48) and (49) when 1 — g ~ 
i.e. when the bulk bias decreases with system size. This special case, called the weakly 
asymmetric simple exclusion process (WASEP), is characterized by the functions 
7V(l-g) 


E = 


and the boundary conditions 


^(P) = 1, = 2p(l - p) 


OL 


PO = 


Pl = 


a + 7 ' ' " 6 + f3 

It can be shown that the model has a unique stable configuration p. 


(69) 

(70) 

Except for the 


special case when the boundary and bulk biases satisfy the zero-current condition (60), 
the model is out of equilibrium. In this case, as discussed above, the LDF is not 
necessarily smooth. Indeed, if the boundary bias is applied in the direction opposite to 
the bulk bias (po < pi for E > 0 and po > pi for E < 0), the LDF of the model exhibits 
singularities: cusp singularities are formed as \E\ is raised above a threshold value, and 
an analogue of a tricritical point appears as \E\ is increased further. See for details. 

As a simple example that clearly shows the Landau-like nature of these singularities, 
in the following we focus on the limit E —)■ cx), in which case the model becomes 
equivalent to the ordinary PASEP |39] . The LDF has the form [30l |39] 

(j)[pf{x)] = 0a[Pf(a()] + min g[pf{x),y] , (71) 

0<j/<l 

where <f>a represents the analytic component of 0 and 

rv 

Q[pA^)^ y]= dx [pf log(l - Po) + (1 - Pf) logpo] 


+ dx [pf log(l - Pl) + (1 - Pf) logpi] 


(72) 


It was first shown in [39] that there exists pf for which there are two values of y 
minimizing Q, so that 0 becomes non-differentiable at this pf. 

An exact Landau theory for this type of singularities can be derived if both 
the initial configuration (which is stable) and the final configuration have a particle- 
hole symmetry [12] • The boundary condition po = 1/2 — 6 and pi = 1/2 + 6 with 
0 < 5 < 1/2 ensures that the stable configuration p is particle-hole symmetric. The 
final conhguration can be expanded as 


Pii.x) = - 


6 + 26x 


27lmax 

E 

n=l 


an sm[n7Tx) 


(73) 


where Umax is an arbitrary integer. Introducing a change of variable m = y — 1/2, we 
can rewrite ^ as a power series 

1 + 5' 


G{m) = 2 log 


1-5 


00 

fc =0 


(74) 
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Here cq is a constant irrelevant to the singnlar behavior. The other constants (for k > 1) 
are given by 

On, (75a) 


C2fc-1 — 


(- 1 )' 


(2A;- 1)! 


nGodd 


C2k — 


(- 1 ) 


fc+1 


Since 


Cl, C2, 


are 


E (-1) 

nEeven 

combinations 


\2fc-l 

nir) Or 


0'2nn 


(756) 

we may regard 


linear combinations of ai,a 2 
Cl, C 2 ,... C2nn,ax free parameters that determine the other coefficients Ck for k > 2?7,max- 
By choosing an appropriate range of these free parameters, all singnlar behaviors of the 
LDF can be captured by the truncated form 

2?lTnax 


G{m) ^ 2 log 


1 + 5 
1-5 


E 

k=l 


Ck-m 


(76) 


Note that this truncated G{m), with its polynomial form and the requirement of 
minimization with respect to m [imposed by (©]. is an analogue of a Landau free 
energy with an order parameter m. Depending on the value of Umax characterizing 
Pf, a Landau free energy for any kind of multicritical point is obtained. For example, 
if ’^max = 1, we obtain a cusp singularity as illustrated in hgure The singular 


structures around the cusp point are essentially the same as those shown in hgure [^b). 
If we choose Umax = 2 and examine the cross-section ai = 0, we obtain the structure 
shown in hgure [T^ that resembles a phase diagram around a tricritical point: the solid 
red line, on which the hrst derivative of the LDF changes discontinuously, meets the 
red-white line of critical (cusp) points at an analogue of a tricritical point. A pair of 
spinodal (fold) lines also emanate from the tricritical point. In catastrophe theory, this 
singular structure is called a symmetry-restricted butterhy catastrophe na. 

As discussed in 3.2.3 , the order parameter m is naturally interpreted as the only 
momentum component that dihers between coexistent globally minimizing trajectories 
at the hnal time. We note that the coefficient 


Cl = 




n—1 

2 ttr 


(77) 


nEodd 


which is obtained from (75a), satishes dcf/dci ~ m. This indicates that m is proportional 
to a momentum ci conjugate to the coordinate ci, which represents the amplitudes of 
Fourier modes with odd values of n. Excitation of such modes indicates that, even if 
both initial and hnal conhgurations are particle-hole symmetric, a globally minimizing 
trajectory breaks the symmetry. In this sense, m can be regarded as a measure of 
particle-hole asymmetry. For the simplest case of a cusp singularity (umax = 1), we have 
Cl = Oi, which means that coexistent globally minimizing trajectories evolve differently 
in terms of the mode sin(7rx) associated with Oi. This behavior is rehected in the singular 
structures shown in hgure [T^ which are created by trajectories that are “bent” towards 
the direction of ai. For other kinds of singularities (umax > 1), multiple modes contribute 
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Figure 11. The “phase diagram” of PASEP for pf{x) = 1/2 — 5 + 25x + ai sin (ttx) + 
02 sin (27ra::) with 5 = 0.1. The shades indicate the value of minimizing m, and the 
insets illustrate the schematic shapes of G(m) in different areas of the phase space. 
The dashed line represents the fold lines, and the solid line represents the switching 
line. All lines meet at the cusp point, an analogue of a critical point. 



0 0.005 0.01 0.015 0.02 0.025 0.03 


Figure 12. The “phase diagram” of PASEP for pf (x) = 1/2 — 5 + 25x + oi sin (ttx) + 
02 sin (27rx) +04 sin (Ittx) with 5 = 0.1. The shades indicate the value of minimizing to, 
and the insets illustrate the schematic shapes of G(m) in different areas of the phase 
space. The solid red line is a switching line, the red-white line a cusp line, and the 
white lines are fold lines. All lines meet at a tricritical point, marked by a blue dot. 


to m, and the difference between globally minimizing trajectories are expected to involve 
more oscillations in x than sin(7ra;) does; however, this remains yet to be verified. 

5. Summary and outlook 

In this review, we discussed two major scenarios that give rise to singular behaviors 
in LDFs, their underlying Hamiltonian structure, and the known examples of these 
behaviors in finite-dimensional systems and spatially extended diffusive systems. The 
hrst scenario involves a competition between multiple limit sets and generically produces 
analogues of discontinuous transitions. The associated type of singularities has been 
observed only in finite-dimensional systems. The second scenario involves bifurcations of 
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locally minimizing trajectories and is closely related to the integrability of the associated 
Hamiltonian system. It generates singularities that can be described by Landau theories 
for critical and multicritical points, which have been observed in both hnite-dimensional 
and driven diffusive systems. For the former only cusp singularities and their tree graphs 
were observed; this is directly related to the fact that the relevant studies were limited to 
two-dimensional models. Meanwhile, in the latter case, no analogue of the tree graphs, 
which were observed in hnite-dimensional systems, has been found yet. 

As was verihed for the Landau-like singularities, it is natural to expect that the 
origins of singular LDFs are not different for hnite-dimensional and driven dihusive 
systems. Thus, it would be possible to hnd dihusive systems that exhibit singular 
behaviors that have been observed only in hnite-dimensional cases. In order to achieve 
the hrst scenario, one needs to construct driven dihusive systems with metastable 
states, so that competitions between diherent limit sets become possible. To produce 
a graph structure formed by multiple Landau-like singularities, one may consider more 
sophisticated forms of stable states that correspond to higher-dimensional limit sets 
such as limit cycles. We also note that some nontrivial singular structures might 
have been missed by taking cross-sections of the hnal conhguration space for the ease 
of visualization (see the discussions of section |^. All of these points indicate that 
singularities of LDFs in spatially extended systems deserve further investigations. 

It would also be interesting to check how the singular structures are ahected by 
relaxing the main assumptions of the general formalism described in section such 
as continuity of the time variable, Gaussian white noise, and arbitrarily small noise 
intensity. Some studies have already been done in these directions, such as noisy maps 
with discrete time steps jlUlj . Langevin equations with weak colored noise jlU2j . and 
effects of a hnite noise amplitude on the globally minimizing trajectories [103] . Still, a 
coherent picture for singular behaviors (or corrections to them) in these more general 
cases is yet to be established. 

Finally, there remains the question of why some non-equilibrium systems have 
smooth LDFs, even though singular LDFs seem to be more typical. It was pointed 
out that some non-equilibrium systems with exactly known LDFs (which are also 
smooth) satisfy hidden DB relations, which are revealed only by non-local mappings 
to equilibrium systems |in4[ 1105] . Since DB guarantees smooth LDFs for equilibrium 
diffusive systems, one might guess that the presence of hidden DB and properties of the 
associated mapping are deeply related to the smoothness of LDFs in non-equilibrium 
systems. 
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We note that (10) can be derived more directly from ([^ using the standard Martin- 
Siggia-Rose (MSR) procedure [53l IMl ESI l56] . which introduces p by the Fourier 
transform 

rtf 


6{p — F — Gr])= / Vp exp 


-N 


dt p ■ {p — F — Gt}) 


(A.l) 


as 


Here the unit of p has been chosen so that the exponent in (A.l) conveniently scale 
N. Then (|^ can be written as 




rp{tf)=Pt 

lp{ti)=pi 
rp{t{)=pf 


V[p, p, p] exp 


-N 


dt 


'f + p-(p-F-Gv) 


rp{tt)=Pi f ftf 'I 

/ P] exp -A / dt[p-p-H{ pGp)]\ 

Jp{tp=p, I Jk J 


(A.2) 


(A.3) 


While p is integrated along the imaginary axes up to this point, we take the Wick 
rotation p —)■ —ip to place p on the real axes. After then, the saddle-point method can 
be applied to reproduce (10). 
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